cache embeddings in vector store #457

Tyrest · 2023-07-13T23:52:18Z

Now autolabel caches the embeddings when cache=True in the same database where task runs are cached. This resolves the need to recompute all the embeddings every time.

This directly addresses #396

nihit · 2023-07-17T03:37:32Z

src/autolabel/few_shot/vector_store.py

+        Returns:
+            List[List[float]]: List of embeddings.
+        """
+        if self._db_engine:


if db_engine is not set (cache = False), what is the behavior of this function?

nihit · 2023-07-17T03:37:48Z

src/autolabel/few_shot/vector_store.py

+            texts (Iterable[str]): Iterable of texts.
+            embeddings (List[List[float]]): List of embeddings.
+        """
+        if self._db_engine:


Provide feedback

Saved searches

Use saved searches to filter your results more quickly

cache embeddings in vector store #457

cache embeddings in vector store #457

Tyrest commented Jul 13, 2023

nihit Jul 17, 2023

nihit Jul 17, 2023

cache embeddings in vector store #457

cache embeddings in vector store #457

Conversation

Tyrest commented Jul 13, 2023

nihit Jul 17, 2023

Choose a reason for hiding this comment

nihit Jul 17, 2023

Choose a reason for hiding this comment